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Abstract 

Menzerath's law, the tendency of Z, the mean size of the parts, to decrease as 
A, the number of parts, increases is found in language, music and genomes. 
Recently, it has been argued that the presence of the law in genomes is an 
inevitable consequence of the fact that Z = Y/X, which would imply that 
Z ~ 1/A. Z ~ 1/X is a very particular case of Menzerath-Altmann law that 
has been rejected by means of a correlation test between X and Y in genomes, 
being X the number of chromosomes of a species, Y its genome size in bases and 
Z the mean chromosome size. Here we provide rigorous statistical arguments to 
support the correctness of rejecting Z ~ 1/X when X and Y are significantly 
correlated. Furthermore, we correct the recent claim that Z ~ 1/X holds 
if and only if X and Y are independent (Baixeries et al. 2012, Biosystems 
107 (3), 167-173). Indeed, Z ~ 1/A if and only if Y is mean independent 
of A, a statistical property of intermediate strength between independence and 
uncorrelation. However, it is still true that the random breakage model proposed 
to explain Z ~ 1/X with independence between A and Y does not fit real 
genome data. We reject Z ~ 1/A in ten out of eleven taxonomic groups by 
means of a new correlation ratio test. 
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1. Introduction 



Consider that X and Y are two discrete random variables and that Z = Y/X 
with 1^0. For the particular case that Z is a mean, Menzerath's law is the 
tendency of Z to decrease as X increases: X stands for the number of parts of 
the construct (e.g., the number of clauses of a sentence), Y stands for the size 
of the whole in parts (e.g., the length in words of the sentence) and Z stands for 
the mean size of the construct (e.g., the mean length of the clauses in words). 
The dependency between Z and X that Menzerath's law d escribes qualitat ively 



is typically modelled by means of Menzerath-Altmann law (jAltmann 



Z = aX b e cX , 



19801 ). i.e. 
(1) 



where a, b and c are constants. Menzerath's law has been foun d i n lang uage 



(Menzerath 



19541 ) and genomes (jFerrer-i-Cancho and Forns 



2009; 



Li 



2012 ) and 



also through a wide ra nge of studies where Menzerath-Altmann law is fit ted to 
human language (e.g., 



Altma: 



1980; 



Teupenhavn and Altmann 



19911 ) and genomes (IWilde and Schwibb 



1984h and 



1989 



mu sic (|Boroda and Altmann 

III 2012 ) which yields constants a, b and c that support a negative corr elation 
between Z and X at least for sufficiently large X (see ICramerl ([2005) for a 
review of par ameter valu es). Recently, it has been argued that Z = Y/X leads 



inevitably to ([Sole, 



2010) 



aX~ 



(2) 



that is Menzerath-Altmann law with b = — 1 and c = 0. If the argument was 
correct, Menzerath-Altmann law would be a trivial law at least from a math- 
ematical perspective. Whether Eq. [2] holds in genomes, being X the number 



its mean chromosome size, has been debated ( 


Sole 


2010 


Ferrer-i-Cancho et al.. 


2012 


Hernandez-Fernandez et al. 


2011 


Baixeries et al.. 


2012alb 


) . Here we aim 



2 



to provide some theoretical foundations for test ing if Eq. [21 ho l ds and cor 



Baixeries et al 



( 2012a 



In 



rect some incorrect mathematical arguments of 
particular, it will be shown that rejecting Eq. [2] i f X a nd Y are correlated 



( Baixeries et al 



2012a : 



Hernandez-Fernandez et al 



20111 ) is correct but it will 



be sho wn that the claim that Eq. [2] is equivalent to independence between X 



and Y (Baixeries et al 



2012al ) is incorrect because that equation holds if and 



only if Y is mean independent of X. Furthermore, a new test that rejects Eq. 
[2] in all taxonomic groups considered so far except one will be presented. 

2. Mathematical preliminaries 

2.1. The meaning of Z = a/X. 

According to standard modelling, claiming that Eq. [2] holds can be recast 



as (jRitz and Streibie 



20081 pp. 1), 



E{Z\X = x} = a/x, 



(3) 



for any x, being E[Z\X = x] the conditional expectation of Z given x (a concrete 
value of X). 

The next Lemma indicates that testing if a real sample follows E[Z\X = 
x] = a/x is equivalent to testing if Y is mean independent of X . 

Lemma 1. Consider a constant a, two random natural variables, X andY, and 
a third random number Z, such that X > and Z = Y/X. Then, E[Z\X = 
x] = a/x if and only if E[Y\X = x] = a for any x. 



Proof. E[Z\X = x] = E[(l/x)Y\X = x] = E[Y\X = x]/x. 



□ 



So far, we have not cared about the value of a. The following theorem indicates 
that a is not arbitrary, showing the equivalence between the c onstancy of the 

19951 pp. 67), a con 



conditional expectation and mean independ ence (Poiriei 



dition that is well-known in econometrics (ICameron et al 
201Q). 



2009; 



Wooldridge . 
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Lemma 2. Consider a constant a and two random natural variables, X and 
Y. E[Y\X = x] = a for any x if and only ifY is mean independent of X, i.e. 
E[Y\X = x] = E[Y] for any x. 

PROOF. Showing that E[Y\X = x] = E[Y] for any x implies = x] = a 

for any x is trivial because E[Y] does not depend on x. Now we aim to show that 
£?[y|JC = x] = a for any x implies E \Y\X = x] = E\Y] for any x. By the law 



of total probability for expectations (jDeGroot and Schervish , 



20ia pp. 258), 



E[Y] = E[E[Y\X = x]] and the substitution E[Y\X = x] = a, E[Y] = E[a] = a. 
□ 

The next theorem indicates that testing if Eq. [5] holds reduces to testing if 
E[Z\X = x}= E[Y] for any x. 

Theorem 3. Consider a constant a and two random natural variables, X and 
Y, and a third random number Z, such that X > and Z = Y/X. Then, 
E[Z\X = x] = a/x if and only ifY is mean independent of X, i.e. E\^\X — 
x] = E[Y] for any x. 

Proof. Chaining LcmmaQ]and LcmmaEl we have E[Z\X = x] = a/x if and 
only if E[Z\X = x] = E[Y] and by Lemma [2] we have a = E[Y). □ 

Wc have examined one condition for a trivial Menzerath-Altmann law, namely 
that Y is mean independent of X . Another more obvious mathematically trivial 
version of the law occurs when Z is mean independent of X , i.e. 



E[Z\X 



E[Z], 



(4) 



which is equivalent to constant E[Z\X = x] by Lemma [21 The analysis of the 
correlation between Z and X in g enomes discarded this const a ncy o f Z for nine 



out of eleven taxonomic gro ups ( Ferrer-i-Cancho and Forns 



with an updated dataset by 



Baixeries et al 



2009 . confirmed 



2012ah ). Therefore, Menzerath- 



Altmann law as a model of E[Z\X = x] has two trivial versions: 
• b = c = 0: Z is mean independent of X. 
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b = — 1 and c = 0: Y is mean independent of X. 



Interestingly, b lies between and —1 when c = is assumed: e.g., b = — 0.27± 
0.11 in language, bei ng Z is the mean clause length i n sentences and X is the 



number of sentences (jTeupenhavn and Altmannl . 



1984 ). and b = -0.44±0.09 in 



music, being Z is the mean F-motif length in tones and X is the number of F- 



motifs (Boroda and Altmann 



19911 ). In both cases, we report b = p, ± a, where 



b is the exponent of a sample while \i and a are, the mean and the standard 
deviation of b in an ensemble of samples, respectively. 

2.2. Three definitions of lack of association between X and Y . 

For the remainder of sections, it is important to bear in mi nd the definition 



19951 . pp. 67-68): 



of three statistical properties between X and Y IjPoirier , 

• X and Y are independent: p(Y = y\X = x) = p(Y = y) for any x and y. 

• Y is mean independent of X: E\Y\X = x] = E[Y] for any x. 

• X and Y are uncorrelated: COV(X,Y) = where COV(X,Y) = 
E[XY] — E[X]E[Y] is the covariance between X and Y. Notice that 
uncorrelation, i.e. p(X,Y) — 0, being p(X, Y) the Pearson correlation 
coeffi cient, is equivalent to zero covariance as (jDeGroot and Schervish , 



20121 ) 



P(X,Y) 



COV{X, Y) 



(5) 



a(X)a(Y) ' 

with a(X) and a(Y) as the standard deviation of X and Y, respectively. 

As X and Y are uncorrelated if and only if p(X, Y) = (or COV(X, Y) = 0), 
Y is mean independent of X if and only if n(Y, X) = 0, where r](Y, X) is a less- 
known association metric: the correlation ratio iKrus kail (|1958l ). n(Y, X) derives 

(G) 



from the variance of E[Y\X = X], which is by definition, 

V[E[Y\X = x}} = E[(E\Y\X = x] - E[E[Y\X = x}]) 2 }. 



By the law of total probability for expectations (jDeGroot and Schervish 
pp. 258), E[E[Y\X = x}} = E[Y] and thus 



2012 



V[E[Y\X = x}} = E[{E[Y\X = x] - E[Y}) 2 ]. 



(7) 
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From this variance, the correlation ratio of Y on X is defined as iKruskall (|l958[ ) 

1/2 



V(Y,X) 



V[Y] 
a{E[Y\X 



a[Y] 



(8) 
(9) 



where cr(...) indicates the stan dard deviation . Notice that < rj(Y,X) < 1 
(whereas -1 < p(X,Y) < 1) |Kruskal Il958l pp. 816-817). As p{X,Y) is a 
normalized COV{X, Y), y(Y,X) is a normalized V\E\Y\X = x]]. 



It is well-known that (|Kolmogorov 



2008; 



Poirier 



1995) 



X and Y are independent 

Y is mean independent of X (r](Y, X) 
4 



0) 



X and Y are uncorrelated (p(A, Y) = 0) 

Mean independence implies uncorrelation but the reverse (uncorrelation implies 
mean independence) is not true in general (sec | Appendix A| for a counterexam- 
ple). Similarly, independence implies mean independence but the reverse (mean 
independence implies independence) is not true in general (see | Appendix A] for 
a count erexample). Proofs o f the top t o bottom impli cations have been provided 
by, e.g.,|KoimogoroyJ (|2008l pp. 60) or IPoirierl (|1995l pp. 67). 

In the next section it will be shown that the correlation ratio is indeed more 
powerful than a correlation coefficient for testing if Eq. [2] holds. 



3. How to test that Z — a/X. 

3.1. A powerful test to reject Z = a/X. 

For the analyses of this sect ion we used the same dataset us ed by 



( 201lh : 



Baixeries et al 



(|2012aF bh: 



Hernandez-Fernandez et al 



Ferrer-i-Cancho et al 



(|2012l ). As the fact that 



Y is mean independent of X implies uncorrelation, i.e. COV(X,Y) = 0, Eq. 
[2] can be tested by means of the following procedure: if COV(X, Y) is signifi- 
cantly different from then reject Eq. otherwise accept it. That procedure 
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N 


P{X,Y) 


T)-\IP\ lllP 

fj V Cll LAV, 


Fi 1 n £n 


56 





41 


0.002 


Angiosperms 


4706 




0.0024 


0.9 


Gymnosperms 


170 





1 


0.2 


Insects 


269 





09 


0.1 


Reptiles 


170 





31 


10~ 5 


Birds 


99 




0.029 


0.8 


Mammals 


371 





3 


< 10" 5 


Cartilaginous fishes 


52 





014 


0.9 


Jawless fishes 


13 




0.76 


0.003 


Ray-finned fishes 


647 





47 


< 10~ 5 


Amphibians 


315 





13 


0.02 



Table 1: Analysis of the association between Y (genome size in bases) and X (chromosome 
number) by means of a Pearson correlation test. N is the number of species (the sample 
size), p(X, Y) is the sample Pearson correlation coefficient and p- value is an estimation of the 
probability that a permutation of X yields an association at least as large as p(X, Y) (the 
test is two-sided). Values of p(X, Y) and p- value were rounded to leave only two or only one 
significant digit, respectively. R = 1 5 permutations were used. 



can be used to reject Eq. [5] in genomes, being Z the mean chromosome length 
in bases of a species and X being the number of chromosomes of that species 



( Hernandez-Ferna ndez et al 



20111 ) Table Q] summarizes the results of the analy- 



sis of the Pearson correlation between X (chromosome number) and Y (genome 
size in bases) in genomes using a per mutation test (a particular case of random- 



ization test (Sokal and Rohlf, 



19951 . pp. 803-819)). A significant correlation 



is found in six out of eleven taxonomic groups. The test is conservative as it 
rejects Eq. [5] indirectly by means of a necessary condition for this equation to 
hold: COV(X, Y) = 0. Therefore, the five two groups where the Eq. [2] could 
not be rejected might be false negatives. Pearson correlation is a measure of 
linearity and has difficulties for capturing non-linear dependencies. A possible 
improvement is using a more powerful correlation metric such as ps{X, Y) 1 the 
Spearman rank correlation coefficient, which is a measure of monotonic (linear 
or non-linear) dependency IZhou et al.l (120031 ) . The Spearman rank correlation 
test revealed that the majority of taxonomic groups (nine out of eleven) ex- 
hibit a significant correlation betwe en X and Y that is incompatible with Eq. [2] 



([Hernandez-Fernandez et al 



20111 ) . The exceptions are birds and cartilaginous 
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n(Y X) 


T\—\T9\ lnp 
jj V Chi 




56 


0.74 


0.03 


Angiosperms 


4706 


0.27 


0.001 


Gymnosperms 


170 


0.74 


< 10~ 5 


Insects 


269 


0.46 


0.02 


Reptiles 


170 


0.48 


0.003 


Birds 


99 


0.78 


0.001 


Mammals 


371 


0.68 


< 10~ 5 


Cartilaginous fishes 


52 


0.76 


0.1 


Jawless fishes 


13 


0.98 


0.05 


Ray-finned fishes 


647 


0.69 


< 10- 5 


Amphibians 


315 


0.58 


< 10~ 5 



Tabic 2: Analysis of the association between Y (genome size in bases) and X (chromosome 
number) by means of a correlation ratio test. The format is similar to that of Table[l] r)(Y, X) 
is the sample correlation ratio of Y on X, p- value is an estimation of the probability that a 
permutation of X yields an association as large as r)(Y, X) (the test is one-sided). R = 10 5 
permutations were used. 



fishes. However, there is a more powerful way of testing Eq. [2J testing directly 



if Y is mean independent of X from its d efinition, Le^E[Y\X = x] = E[Y] for 



any x, which is equivalent to rj{X, Y = (|Kruskal 



1958). 



Table [2] summarizes the results of the analysis of the correlation ratio of Y 
(genome size in bases) on X (chromosome number) in genomes using a per- 
mutation test. r](Y,X) was not significantly large in one taxonomic group: 
cartilaginous fishes. Mean independence and, equivalently, Eq. [5J cannot be 
rejected for only one out of eleven groups. 

Table [3] summarizes the results of the Pearson, Spearman and correlation 
ration test. The number of taxonomic groups for which a test rejects Eq. [5] is 
6, 9, and 10, respectively. The qualitative summary for p(X,Y) and r/(Y,X) 
comes, r espectively, from Table [1] and El Th e qualitative summary for ps(X, Y) 



is due to 



Hernandez-Fernandez et al 



20111 ). The power of the correlation ratio 



test can be easily explained by the fact that it can only be zero when mean 
independence fails. Table [3] suggests that Spearman rank correlation has an 
intermediate power between Pearson correlation and correlation ratio. 



Taxonomic group p(X,Y) ps(X 7 Y) rj(Y,X) 



Fungi 


Yes 


Yes 


Yes 


Angiosperms 




Yes 


Yes 


Gymnosperms 




Yes 


Yes 


Insects 




Yes 


Yes 


Reptiles 


Yes 


Yes 


Yes 


Birds 






Yes 


Mammals 


Yes 


Yes 


Yes 


Cartilaginous fishes 








Jawlcss fishes 


Yes 


Yes 


Yes 


Ray-finned fishes 


Yes 


Yes 


Yes 


Amphibians 


Yes 


Yes 


Yes 



Tabic 3: Summary of the analysis of the association between X (genome size in bases) and 
Y (chromosome number) in genomes. Three statistics are considered: the sample Pearson 
correlation coefficient p(X, Y), the sample Spearman correlation coefficient pg(X, Y) and the 
sample correlation ratio (r](Y, X)). 'Yes' indicates that the corresponding correlation test 
indicates a significant correlation at a significance level of 0.05. 



3.2. A weak test to accept Z = a/X . 

The hypothesis of Z = a/X h as been acc epted with the only support that 
the fit of Z = aX b yields b 



1 (ISole . 



2010T ). This procedure is very prone to 
type II error (accepting a false null hypothesis) as i t need s that Z = aX b holds 



first (Baixeries et al 



2012b 



Ferrer-i-Cancho et al 



20121 ). Our analysis shows 
that for Z = a/X to hold, it is not only necessary that b ps —1 is retrieved 
but also a w p[Y], where p[Y] is the mean of Y, an estimate of E[Y] (recall 
Theorem [3]). Even if a ~ p[Y] and b « — 1, type II errors are not excluded and 
minimizing them needs evidence that Z = aX b is well-supported by data. 

4. Theorem 1 and Corollary 1 by Baixeries et al. are incorrect 



In a recent paper, if has been claimed that (Theorem 1 by 
( 2012ah ) that 



Baixeries et al 



Two random natural numbers X and Y , such that X > 0, are independent 
if and only if Z = Y/X satisfies E[Z\X] = E[Y]/X. 



In order to be correct, that theorem should state 
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Given two random natural variables X and Y , such that X > 0, Y is mean 
independent of X if and only if Z = Y/X satisfies E[Z\X] = E[Y]/X. 



or 



If two random natural variables X and Y , such that X > 0, are indepen- 
dent then Z = Y/X satisfies E[Z\X] = E[Y]/X. 



The p oint is Theorem [3] and the fact th at independence implies mean indepen- 



dence ( Kolmogorov 



2008 



Poirier 



Baixeries et al 



1995 ) but th e reverse does not hold ( |Appcndix A[ ) . 



2012a ) for their incorrect theorem indeed 



The proof provided by 
only demonstrates that independence implies E[Z\X] = E[Y}/X. Theorem [3] 
and the fact that independence is more restrictive than mean independence 
< |Appcndix A|) ind i cate th at the converse is impossible to prove. 

(|2012al ) studied a general class of random models where X 



Baixeries et al 



and Y are independent, with Z = Y/X, which is generalization of a random 



model where X and Y are independent but distributed uniformly (jSolel . 120101 ) . 
For the generalized class where X and Y remain independent but not necessar- 
ily distributed uniform ly, the following corollary was presented (Corollary 1 by 



Baixeries et al 



l|2012ah : 



The general class of random models above is equivalent to the class of mod- 
els yielding E[L c \L g ] — aL~" , with a = E[G] and (3 = 1. 

(the meaning of the notation is the following: X = L g) Y = G, Z = L c = G/L g 
and b = 0). 

That corollary is incorrect as these random models are only a subclass of all the 
models yielding Eq. [2] In order to be correct, it should state 
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The general class of random models above is a strict subset of the class of 
models yielding E[L c \L g ] = aL~P , with a = E[G] and /3 = 1. 



Again, the point is that independence implies mean independence but not the 
reverse. Therefore, the class of generalized class of random models where X 
and Y arc independent covers only a fraction of the m odels that according to 
Theorem lead to Eq. O Further corrections needed by 
are provided in |Appendix B 



Baixeries et al 



(2012a 



5. Discussion 



We have shown that 



• Claiming that Z and X follow a very particular form of Menzcrath- 
Altmann law, i.e. Eq. [2j is indeed equivalent to claiming that 



E\Z\X\ = E[Y]/X. 



(10) 



holds. 



• Claiming that Eq. QJJ] holds is equivalent to claiming that Y is mean 
independent of X. 

• The previous claim t hat independence betw een X and Y is equivalent to 
mean independence (jBaixeries et all l2012al ) is wrong. 



• A new correlation ratio test shows that Eq. [TU] could only hold in carti- 
laginous fishes. 

It is still true that the rand om breakage model where X and Y are independent 
and uniformly distributed (jSola I2010T ) fails to fit the majority of taxonomic 
groups because independence is a particular case of mean independence and 
mean independence nee ds fails in at least ten out of eleven taxonomic groups 
(Table [3]). Furthermore, 



Baixeries et al 



(|2012al ) have argued that independence 



between X and Y is problematic as it can lead to organisms with empty chro- 
mosomes or empty chromosome parts. Interestingly, Y does not need to be the 
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size of genome in bases. It could be the size in units between the base and the 
chromosome. 

The problem of empty components also concerns mean independence. The 
condition for not expecting empty chromosomes for a given x (a concrete value 
of X) is 



E[Z\X 



1 



-E\Y\X 



E\Y\X = x] 



> 1 

> 1. 
x. 



(11) 



For that x, the condition in Eq. [Tl]becomes E[Y] > x when Y is mean indepen- 
dent of X as = x] = E[Y] in that case. Thus, under mean independence, 
empty chromosomes are expected in an organisms of x chromosomes if E[Y] < x. 
Notice that expecting that Eq. QT] holds on average for any x, leads to 



E\E[Y\X = x}} > E[X] 
E[Y] > E[X] 



(12) 



thank s to the law of total probability for expectations (jDeGroot and Schervish , 



20121 pp. 258). The restr i ctions d efined by Eqs. [TT] and [12] arc perhaps very 



simple but 



Baixeries et al 



(|2012al) considered more elaborated constraints for 
the viability of an organism based upon the parts making an ideal chromosome: 
a centromere, two telomeres and a couple of intermediate regions. Those via- 
bility constraints lead to a deviation from Menzera th-Altman law with b = — 1 

(|2012al) ). which Theorem [3] allows 



and 



(see Fig. 3 of 



Baixeries et al 



one to interpret unequivocally as a departure from mean independence. There- 
fore, the viability and well-formedness of chromosomes is not compatible with 
mean independence either. It is still true that the negative correlation between 



(Ferrer-i-Cancho and Fori 


IS 




2009 


Eq. [5] is inevitable ( 


Soli 


2010 


) is 



Wilde and Schwibbe 



19891 ). Claiming that 



independent of X in any circumstance, a very strong requirement for real lan- 
guage, music and genomes. 
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Appendix A. Counterexamples 

Appendix A.l. IfYis mean independent of X then X and Y are not necessarily 
independent 

Consider that 

1/2 if X = and y = 

p(X = x,Y = y) = { 1/4 if x = 1 and y = 1 (A.l) 

1/4 if x = 1 and y = — 1 

Thus E(Y\X = 1) = (l/2)(— 1) + (1/2)1 = and E(Y\X = 0) = 0. Therefore 
Y is mean independent of X but X and Y are not independent because p(X — 
1,Y = 0) = 0^p(X = l)p(Y = 0) asp(A = 1) = 1/2 and p(Y = 0) = 1/2. 

Appendix A. 2. Uncorr elation between X and Y does not imply that Y is mean 
independent of X 

Consider that 

1/2 if x = and y = -1 

p(X = x,Y = y) = \ 1/4 if x = -1 and y = 1 (A.2) 

1/4 if x = 1 and y = 1 

Thus E(X) = E(Y) = and E(XY) = (l/4)(-l) + (1/2)0 + (1/4)1 = 0. 
Therefore COV(X, Y) = but Y is not mean independent of X because 
E(Y\X = -1) = 1 ^ E(Y\X = 0) = -1. 



Appendix B. Corrections on lBaixeries et al.l (|2012af ) 



Bes ides the theorem and the corollary revised in Section |H 



Baixeries et al 



(2012a)) needs corrections in other places: 
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p. 168 Menzerath-Altmann law with 6=1 and c = is equivalent to inde- 
pendence between G and L g . 

should read 

Menzerath-Altmann law with 6=1 and c = is equivalent to G being 
mean independent of L g . 

p. 168 the need of independence between G and L g to obtain Menzerath- 
Altmann law with 6=1 and c = 0. 

should read 

the need that G is mean independent of L g to obtain Menzerath- 
Altmann law with 6=1 and c = 0. 

p. 170 In all the calculations that follow, true independence between G and 
L g is assumed. 

should read 

In all the calculations that follow, mean independence between G 
and L g (which includes independence between G and L g as a 
particular case) is assumed. 

p. 171. Corollary 1 states that E[L c \L g ] ~ 1/L g can only be achieved by 
independence between G and L g 

should read 

Corollary 1 states that E[L c \L g ] ~ l/L g can only be achieved if G is 
mean independent of L g . 
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